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ABSTRACT 

The objective of this program, which was created in 
response to the emergency situation in New York City's Community 
School District 3, was to train all guidance counselors, social 
workers, and nurses in the district to develop the skills to deliver 
substance abuse prevention counseling and support services. Program 
sponsored training was to be evaluated through administering pretests 
and postests to participants. In addition, observations of counseling 
methods and prevention services were to be conducted to assess the 
ability of staff to translate program training into job appropriate 
skills. A total of 14 staff development activities were held for 
guidance counselors, social workers, and nurses in which 196 staff 
members participated. The content of staff development activities met 
program objectives. They included information on substance abuse and 
related social, health, and developmental issues, strategies for 
providing emotional support and building self-esteem. Much of the 
material was age-specific, and culturally sensitive. Feedback about 
the workshops was fur, Ished through evaluation forms. In general, 
workshop activities were highly rated. The appendix consists of five 
tables showing program outcomes and participant responses to 
workshops. (BF) 
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FYFrTTTTVK SUMMARY 



PROJECT BACKGROUND 

The 1991-92 Model System-Wide K-9 Alcohol and Drug Abuse 
Prevention Training Program for Counselors, Social Workers, and 
Nurses was a federally funded project created in response to the 
emergency situ-^tion in Community School District 3. The program 
objective was to train all guidance counselors, social workers, 
and nurses* in the district to develop the skills to deliver 
substance abuse prevention counselling and support services. 
Program sponsored training was to be evaluated through 
administering pretests and postests to participants. In 
addition, observations of counseling methods and prevention 
services were to be conducted to assess the ability of staff to 
translate program training into job appropriate skills. 



PROJECT FINDINGS 

There were 88 staff development events held in the district 
during 1991-1992 which addressed substance abuse and related 
issues. A total of 14 staff development activities were held for 
guidance counsellors, social workers, and nurses in which 196 
staff members participated". All the guidance counsellors and 
social workers in the district attended at least one training 
sGssxon • 

The content of staff development activities met program 
objectives. They included information on substance abuse and 
related social, health, and developmental issues, strategies for 
providing emotional support and building self-esteem, student 
activities designed to encourage critical thinking about drugs 
and sociopolitical issues, and ways of enabling students to 
pursue creative activities. Much of the material was age- 
specific, and culturally sensitive, as specified in the proposal 
guidelines. 

Feedback about the workshops was furnished through 
evaluation forms. In general, workshop activities were highly 
rated. Staff described the workshops attended to be useful in 
the knowl«dg« and group support provided, and most stated that 
they came away better aware of the problems related to substance 
abuse, and of what they could do to address them. Over 50 



* This includes 25 guidance counsel,5rs, 5 social workers, 
and 5 nurses. 

** This number does not eliminate the overlapping that 
occurred when the same individual participated in more than one 
activity. 
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percent of the participants in staff workshops gave the workshops 
excellent ratings in all areas. 

Data submitted to O.E.R. for program evaluation were survey 
material from workshops and records of program activities. After 
a review of the submitted data, O.E.R. found that the assessment 
measures outlined in the proposal were not.. utilized. Neither were 
criterion referenced pre and post tests nor were program 
developed observation checklists used. Therefore, these data 
form the basis for O.E.R. 's evaluation. 



CONCLUSIONS AND RECOMMENDATIONS : 

The program objectives were largely met in terms of the 
kinds and numbers of staff development activities held. Based on 
these findings O.E.R. recommends: 

• District administrators should continue to design similar 
staff development activities as those implemented in 
1991-92. 

• Staff development training attendance sheets should have 
a space designated for participants' job titles, in order 
to determine how many of the targeted staff were trained. 

• District staff should provide technical assistance to 
school staff so that the information from workshops 
can be readily applied in concrete situations, 

• Information should be provided on the extent to which the 
services of community providers are being utilized by 
staff and students. 

• As specified in the proposal, pre and post criterion 
referenced tests should be administered to evaluate the 
knowledge that participants obtained through program 
participation. 

• As specified in the proposal, staff trainees should be 
observed in order to assess the success of training in 
applied situations. 
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I . INTRODUCTION 
This report documents the Office of Educational Research 
(O.E.R.'s) evaluation of the 1991-92 drug abuse prevention and 
education grant for the Model System-Wide K-9 Drug/Alcohol Abuse 
Prevention Training Program for Counselors, Social Workers, and 
Nurses awarded to Community School District 3 (CSD 3). Developed 
in response to the acute needs of children in the community 
school district feeder neighborhoods, the program targets the 
entire counselor, social worker, and nursing staff employed in 
the district*. 

PROGRAM OBJECTIVES INDICATED IN THE PROPOSAL 

The overall program objective was to provide the 3 5 targeted 
guidance counselors, social workers, and nurses with knowledge 
and skills that would enabl3 them to deliver substance abuse 
prevention counselling and support services to students and their 
families. Through participating in a variety of training 
activities from July 1991 through August 1992 staff were to 
demonstrate increased knowledge and skills associated with: 

• an in-depth, culturally sensitive, accurate, and age- 
appropriate understanding of the substance abuse field 
including the pharmacological and psychosocial causes of 
drug and alcohol abuse; 

• the role of tobacco, marijuana, and alcohol as gateway 
drugs ; 

• an awareness of how social attitudes and values 

" This includes 25 guidance counselors, 5 social workers, 
and 5 nurses. 



contribute to the alcohol and drug abuse syndrome; 

• how to counter the "responsible use" message often 
promoted in the media; 

• building student's self-esteem; 

• promoting student success and helping students develop 
appropriate life skills to resist drugs and alcohol; 

• ability to counsel students on how to say "no" while 
retaining friends and status within their peer group; 

• serving as effective role models; 

• understanding and addressing the needs of children of 
alcoholics; 

• developing meaningful opportunities for parent 
participation; 

• mobilizing community resources in support of substance 
abuse prevention education; 

• enabling students to identify and reduce personal risk 
factors and to recognize and manage stress without the 
use of drugs; and 

• providing counseling in decision-making, and problem- 
solving skills. 

To achieve the objectives a variety of staff development 
training activities were to be implemented. These included: - 
ten-day summer training program; enrollment in specially designed 
college courses'; participation in a series of workshops and 
training programs; as well as attendance at professional 
conferences and presentations conducted by the New York State 
Education- Department and the Federal Northeast Regional Center 
for Drug Abuse Prevention. Community-based substance abuse 



* Courses were designed by the District and City College of 
the City University of New York 
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prevention education service providers were also to provide staff 
development. 

DISTRICT EVALUATION PLAN 

According to the proposal, targeted staff will be assessed 
in the following manner: 

(a) Criterion referenced pre- and post-tests will be 
administered to staff in order to test their knowledge of 
concepts, methods, and materials in drug/alcohol abuse 
prevention counseling and support services; 

(b) Staff ability to use drug/alcohol abuse counseling 
methods will be measured by observation of trainees in a job 
appropriate setting by using program developed checklists. 



3 



ERIC 



11 



II. O.E.R. EVALUATION 
O.E.R. EVALUATION MATERIALS AND METHODOLOGY 

The Office of Educational Research of the New York City 
Public Schools conducted an evaluation of the Model System-wide 
K-9 Drug/ Alcohol Abuse Prevention Training program activities 
over the period July 1991-August 1992 to assess whether CSD 3 
attained its objectives. 
Evaluation Material 

After a review of the data, O.E.R. found that the assessment 
measures outlined in the proposal were not utilized. Neither 
were criterion referenced pre and post tests used nor were 
classroom observation checklists administered. The only data 
submitted were survey materials from workshops and records of 
program activities. Therefore, these data formed the bases for 
O.E.R. 's evaluation. 
O.E.R. EVALUATION FINDINGS 
Overview 

Appendix table 1 compares the planned project services to 
those implemented. Appendix table 2 indicates that 196 staff 
persons attended training which far exceeds the estimated 35 from 
the proposal*. Guidance counsellors, social workers, and nurses 
did attend other staff development activitiesi; however, at most 



* Because the activities took place as part of the larger 
substance abuse prevention training program, the evaluator has 
not indicated the specific staff groups involved in the training 
as specified in the proposal. 



of these events participants did not indicate job titles. 
Therefore, O.E.R. cannot accurately determine the total number of 
guidance counselors, social workers, and nurses who received 
training. All guidance counsellors and social workers in the 
district attended at least one training session. O.E.R. has no 
conclusive data on the number of nurses who participated in staff 
development. 

Table 3 tabulates events held for targeted staiff. A variety 
of resources — including community based organizations, 
hospitals, and universities — were sought out to develop a 
thorough training program encompassing all aspects of substance 
abuse prevention education. As proposed, the City University of 
New York conducted a number of training activities. In addition 
to collaborating with other organizations to provide services, 
project personnel themselves provided a variety of workshops on 
conflict-resolution, consciousness building, and group dynamics 
as proposed. 

Staff development workshops addressed many of the program 
objectives. Workshops provided staff with knowledge of the 
psychological, physiological, and sociological aspects of 
substance abuse. In addition to workshops on substance abuse, 
workshops w«r« held on ch.rld development, and on specific 
psychological issues such as Child Abuse and Adolescent Attention 
Deficit Hyperactivity Disorder, and Post-Traumatic stress 
Syndrome. Staff were trained to identify signs of addiction, and 
family-based problems such as child abuse and substance abusing 

5 
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family members. Workshops provided referral information, and to 
the extent to which possible, staff were trained to address 
addiction and intervene with substance abusing families. 
Additionally, strategies for imparting refusal, coping, stress 
management, and communication skills to parents and students were 
discussed. 

Feedback from staff participants indicated that the 
workshops were well appreciated. Participant assessments of each 
of the staff developinent workshops for which evaluation forms 
were provided are detailed in appendix tables 4-8*. Participants 
especially valued the information presented by the facilitator, 
the benefits of small group discussion where participants raised 
specific cases, the provision of resource and referral 
information, and the chance to meet key personnel. Responses to 
the question of what participants considered the most helpful 
aspect of the workshops included: "Getting to know each other", 
"A greater awareness of how to be with children", and "Being able 
to express myself". Some of the comments on how participants 
thought the workshop had changed them included: "I will be more 
observant", "I will try to be a better listener" and "I will try 
harder to reach people and to help others". 

The presentations on AIDS, stress management, and the 
discussions of individual cases were greatly appreciated. The 
following were suggested future workshop topics: AIDS, family 



* Evaluation forms did not accompany all of the staff 
workshops . 



relationships, self-esteem building activities, communication 
techniques, substance abusing parents, and conflict resolution. 
Participants made the following recommendations to improve 
workshops: 

1. Workshops should be more structured and the speakers 
should increase their facilitation of group discussion. 

2 . There should be more discussion of ways workshop 
information can be applied in concrete situations. 
Guidance counsellors asked for more in-school non- 
clinical ways in which the material presented can be made 
relevant to counselling. 

3. More training should be provided on how to communicate 
with students and parents, and on how to encourage them 
to express themselves freely. 

4. Workshop sessions should be longer with more follow-up 
workshops and follow through of specific cases that were 
discussed. 

Since no classroom observation data were submitted, OREA could 
not determine whether trainees' skills in providing substance 
abuse prevention education increased. 



II. CONCLUSIONS AND RECOMMENDATIONS 

CONCLUSIONS 

Overall, program activities provided a comprehensive 
substance abuse prevention education by addressing substance 
abuse in the context of its related sociological, psychological 
and physiological aspects. The program met its primary task of 
providing staff with knowledge of, and skills in substance abuse 
prevention counseling and job appropriate services. The actual 
number of staff participants exceeded the numbers proposed. 
Program activities met proposal specifications in terms of 
concepts addressed and kinds of activities implemented. 
Workshops were well attended and appreciated for the knowledge, 
group support, and practical information that they provided, and 
for the confidence that they instilled in participants. 

On the other hand, since no job-site observations were 
conducted, O.E.R. was unable to determine the extent to which 
staff applied the substance abuse prevention training received. 
In addition, since staff did not specify position titles on 
workshop attendance sheets, O.E.R. could not determine whether 
the pivotal objective of involving all the proposed target groups 
in a preventive effort was met. 

T?Rf!OMWENDATIONS 

Based on the above findings, the following recommendations 
are made to meet project goals and enhance evaluation measures: 

• Efforts should be made to include nurses in staff 
training. 

• Project leaders should provide information on whether 

8 



the staff actively mobilizes parents/community in 
substance abuse prevention education. 

As specified in the proposal, pre and post criterion 
referenced tests should be administered to evaluate the 
knowledge that staff obtained through program 
participation. 

Staff development training attendance sheets should 
have a space designated for participants' job titles. 

As specified in the proposal, staff trainees should be 
observed in order to assess the success of training in 
applied situations. 

Workshop time should be more effectively managed to 
better meet participants' needs. 

School staff members should be provided with 
information on resources for helping families. 



IV 
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Appendix Table 1 
Program Objectives and Outcomes 



Benefits 



Objectives 



Outcomes 



No. of staff trained 



35 



196* 



Percent of staff able to 
demonstrate increased 
knowledge of 
prevention education 



85 



NO. Of training events 
implementea 



60 



14 



No. Of person training- 
days delivered 



400 



b 



No. of experts involved 



25 



44 



No. Of community based 
organizations that assisted 
in training 



' Staff who attended more than one workshop were counted more 
than once. 

* Data not available. 
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